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Abstract 

We search for a Higgs particle with anomalous couplings in the e"'"e^ —>■ H7, 
e"'"e~ — ^ HZ and e"'"e~ — > He"'"e~ processes with the L3 detector at LEP. We explore 
the mass range 70 GeV < mn < 170 GeV using 176 pb~^ of integrated luminosity at 
a center-of-mass energy of -y/i = 189 GeV. The Higgs decays H — > bb, H — > 77 and 
H ^ Z7 are considered in the analysis. No evidence for anomalous Higgs production 
is found. This is interpreted in terms of limits on the anomalous couplings d, ds, 
Agf and Ak^. Limits on the r(H — 77) and r(H — Z7) partial widths in the 
explored Higgs mass range are also obtained. 
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1 Introduction 



The spontaneous symmetry breaking mechanism is a fundamental constituent of the Standard 
Model (SM) PJ of electroweak interactions. Despite its relevance, the experimental information 
on the Higgs sector of the SM is scarce and indirect at present. The search for the Higgs particle 
is a key issue for present and future high-energy colliders, and any deviation from expectations 
could be a clear guide for new physics scenarios beyond the SM. 

The SM can be extended via a linear representation of the SU{2)l x U{1)y symmetry 
breaking mechanism [2]. The lowest order representation corresponds to the Standard Model, 
while at higher orders new interactions between the Higgs particle and gauge bosons become 
possible. They modify the production mechanisms and decay properties of the Higgs. The 
relevant CP-invariant Lagrangian terms for neutral bosons are the following [H]: 



£eff = 9r,, HA^.A'^^ + gi^l^ A^,Z^9^H + g^^^ HA^.Z 

+ Z^^Z^d'^R + gSk HZ^.Z'^'' + gil^ HZ^Z'^ (1) 

where A^, Z^ and H are the photon, Z and Higgs fields, respectively, and X^^ = d^X^ — d^X^. 
The couplings g^^^, g'^l, g^l, g^^l^, g^^l^ and g^^l^ can be parametrized as follows gHHl: 



(7h77 = — ((isin^6'w + cos^6'w) (2) 

9hL = {^9i sin26'w - Ak^ tan6'w) (3) 

g^il, = ^ sin2^w {d-ds) (4) 

9bLz — {^9i cos2^^w + Ak^ tan^6'w) (5) 

9nlz = TT— (dcos^6^Jv + dBsm^e^Jv) (6) 

(3) 9 f^W r frjs, 

9uzz = '^z (7) 

where g is the SU{2)l coupling constant, 6'w is the weak mixing angle and mw is the W 
mass. The five anomalous couplings d, ds, ^gf, Ak^ and 6z constitute a convenient set of 
adimensional parameters to describe deviations in Higgs-vector boson interactions. They are 
not severely constrained by electroweak measurements at the Z pole or low energies ■ The 
couplings Agf and Ak^ are commonly used in the context of e"'"e~ — > W"'"W~ studies jHj, 
whereas the couplings d and ds are introduced according to the convention of Reference IH 
Limits on the parameter = (1 + 6z), which quantifies deviations in the magnitude of the HZZ 
and HWW couplings [H] have already been set [8^ and will not be discussed in this paper. 

A typical signature of anomalous couplings would be a large cross section for a non-standard 
Higgs production mechanism such as e"'"e~ —>■ H7. Another possible effect is the observation 
of large H — > 77 and H — > Z7 branching fractions, which are zero in the SM at tree level. In 
addition, a search for anomalous Higgs production with non-zero Agf or Ak,^ couplings offers 
a complementary way to look for the same type of deviations which may be present in the 
e"'"e~ — >• W"'"W~ process. 

The data used in this analysis were collected with the L3 detector 9] at a center-of-mass 
energy of ^/s = 189 GeV and correspond to an integrated luminosity of 176 pb^^. Previous 
experimental analyses on anomalous Higgs production accompanied by photons are discussed 
in Reference IIUI 
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2 Analysis strategy and Monte Carlo samples 



We search for a Higgs particle emitted in the e^e~ — >■ H7 and e"'"e~ — > He+e^ processes. 
These processes may be enhanced by the presence of anomalous H77 and HZ7 couplings and 
have sensitivity to Higgs masses up to the center-of-mass energy of the collision (mn < ^/s). 
The analysis is complemented with a study of the e^e~ —>■ HZ process, which is sensitive to 
anomalous HZZ and HZ7 couplings for Higgs masses below the kinematic limit: mn < i/i— mz. 
The Feynman diagrams for these three anomalous processes are shown in Figure ^ 

In order to search for the anomalous e"'"e~ —>■ H7 process (Figure ^) a dedicated generator 
is written. It implements the expected (1 + cos^ 6'h) d{cos9ii) dependence for the differential 
cross section as a function of the Higgs production angle, ^h- The generator takes into account 
initial state radiation [llj, photon emission by final-state particles spin correlations and 
off-shell effects in cascade decays like H ^ Z7 ^ ff7. 

The e"'"e~ He"'"e~ process (Figure^) is interpreted as the production of a narrow- width 
spin-zero resonance (the Higgs particle) in two-photon processes. For the generation of this 
process, the PC generator is used. The e"'"e~ — >• HZ process, which is also affected by the 
presence of anomalous couplings [Hj (Figure Ht), is studied by reinterpreting the cross section 
limits obtained from the L3 SM and fermiophobic ^E] Higgs searches. 

The branching fractions and partial widths of an anomalous Higgs are determined according 
to the calculations of References El and ^1 The search is restricted to the Higgs mass range 
70 GeV < TTiH < 170 GeV. The decay channels H — > 77, H — > Z7 and H — > bb are considered. 
The cases H — 77 and H — Z7 complement each other in sensitivity, probing a large part of 
the parameter space. The H — bb decay is dominant in the parameter region where H — 77 
is strongly suppressed and H ^ Z7 is kinematically forbidden. 

The analysis is performed as a function of the Higgs mass hypothesis. Signal events are 
generated for the following six Higgs masses: 70, 90, 110, 130, 150 and 170 GeV. For each 
mass under consideration and for each possible production and decay mode, more than 2000 
signal events are generated. For the study of SM backgrounds the following generators are 
considered: KK2F ^ and PYTHIA for e+e" qq(7) contaminations, PYTHIA for 
multiperipheral e+e" — *• e"'"e~qq events, GGG fore+e" 77(7), KORALW fore"'"e~ 
W"''W~, EXCALIBUR [22] for e"'"e~ —>■ Wez/ and remaining four-fermion backgrounds at high 
invariant masses, and KORALZ |21] for e"'"e~ r+r~(7). In all cases the Monte Carlo (MC) 
statistics used in the analysis is more than 10 times the statistics present in data, except for 
multiperipheral e"'"e~ — >■ e"'"e~qq events, for which the relative factor is two. 

All MC samples are simulated in the L3 detector and reconstructed in the same way as 
data. Time-dependent detector inefficiencies are taken into account. 

3 Event selection 

The e"'"e~ — H7 and e"'"e~ He"'"e~ Higgs production mechanisms lead to characteristic 
topologies. In the e"'"e~ — > H7 process, a high-energy photon of fixed energy is produced, and 
typically most of the collision energy is visible in the final state. Events originating from a two- 
photon collision, e"'"e~ —>■ He"'"e~, have missing longitudinal momentum and missing mass, as 
the two emerging electrons tend to escape detection at very low polar angles. The analysis of the 
specific channel e"'"e~ H7, H — * Z7, is based on the e"'"e~ — > Z77 selection criteria described 
in Reference 123 All analyses are performed in Higgs mass steps of 1 GeV by interpolation 
of the generated Higgs signal efficiencies. This is particularly relevant in the case of photonic 
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Higgs decays, where the good energy resolution of the L3 detector can be exploited efficiently. 

Most of the analyses rely on photon identification. A photon is defined as a shower in the 
electromagnetic calorimeter with a profile consistent with that of an electromagnetic particle 
and no associated track in the vertex chamber. The photon candidates must satisfy > 5 GeV 
and I cos 6*^ |< 0.8, where is the photon energy and 9^ is its polar angle. These cuts reduce 
the background associated to initial and final-state radiation, while keeping a large efficiency 
for the Higgs signal. The identification of H — » bb decays is also crucial in this study. The 
b-tagging performance is similar to the one obtained in the L3 SM Higgs search |2E]- 

3.1 e+e" — > H7 — > 777 analysis 

In order to select e"'"e~ — > H7 — * 777 events we require three photon candidates with a total 
electromagnetic energy larger than ■\/i/2. In addition, the invariant mass of at least one of the 
photon pairs in the event must be consistent with the Higgs mass hypothesis within 3 GeV. 

After these cuts the contamination from processes other than e"'"e~ — *■ 77(7) is estimated 
to be negligible. Figure |2ti presents the distribution of the invariant mass in data and in MC 
for one of the Higgs mass hypotheses with largest signal significance. 

The number of expected and observed events, the signal efficiency in the full phase space, 
and the limit on a{e'^e~ — >■ H7) Br(H 77) are shown in Table ^ for several Higgs mass 
hypotheses. No evidence for any anomalous signal is observed, leading to the 95% confidence 
level (CL) limits shown in Figure 01 Throughout this paper, a Bayesian approach with a flat 
prior distribution is adopted in the derivation of the limits on the signal cross section. 
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Table 1: Number of selected candidates, background events, signal acceptance and 95% CL 
cross section limits after the e"'"e~ — H7 'j'j'j selection for different Higgs mass hypotheses. 



3.2 e"'"e — > H7 — > bb7 analysis 

High particle multiplicity and momentum imbalance cuts are applied in order to select an initial 
sample of hadronic events. A bb7 event is tagged by the presence of an isolated photon and 
b-hadrons (the event b-tag discriminant, -Stag [2^1, must exceed 1.5). 

The contamination in the selected sample is dominated by the almost irreducible e"'"e~ Z7 
process. The remaining backgrounds are estimated to be at the 1% level. The number of 
expected and observed events and the signal acceptance in the full phase space are shown in 
Table El for several Higgs mass hypotheses. 

The distribution of the mass recoiling to the photon in data and in MC for one of the Higgs 
mass hypotheses with largest signal significance is plotted in Figure |21d. This distribution is 
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used to set upper limits on the magnitude of cr(e^e~ — > H7) Br(H bb). There is good 
agreement between data and MC in the absence of a Higgs signal, leading to the limits shown 
in Table El and Figure El 
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Table 2: Number of selected candidates, background events, signal acceptances and cross section 
limits after the e"'"e~ H7 hh'j selection for different Higgs mass hypotheses. 



3.3 e+e — > H7 — > Z77 analysis 

The selection criteria for this channel are the same as those used for the measurement of the 
e"'"e~ — >• H7 — >• Z77 cross section |23|. We select 36 events, in agreement with the expected 
SM background of 39.2. The signal efficiency over the full phase space and the upper limits on 
(T(e+e~ —>■ H7) Br(H Z7) are shown in Table El and Figure El 
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Table 3: Signal acceptances and cross section limits after the e^e —>■ H7 —>■ Z77 selection for 
different Higgs mass hypotheses. 

3.4 e+e" — > He+e", H — > 77 analysis 

The selection of the e"'"e~ e"'"e^H e"^e~77 signal requires the presence of two photon 
candidates in the event. In addition, a kinematic fit to the signal hypothesis is performed. We 
assume that all the missing energy is lost in the beam pipe and that the visible mass of the 
event is consistent with mn within the experimental uncertainties. Finally, a cut on the of 
this fit is applied. 

The distribution of the two photon invariant mass for data and MC after the kinematic fit 
is shown in Figure Et for one of the Higgs mass hypotheses. The background is dominated 
by e"'"e~ — > 77(7) events. Since a{e'^e~ — >■ He"'"e~) is proportional to the partial Higgs width 
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into photons, r(H ^ 77), the cross section hmits are directly interpreted in terms of r(H — >■ 
77) Br(H '-f'-f). The number of expected and observed events and the signal efficiency over 
the full phase space are listed in TableEJfor several Higgs mass hypotheses. There is no evidence 
for any anomalous signal, leading to the 95% CL limits presented in Table |3 and in Figure HJ 
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Table 4: Number of selected candidates, background events, signal acceptances and limits on 
r(H — > 77) Br(H — i> 77) from the e"'"e~ — > e"'"e~H e"'"e~77 selection for different Higgs mass 
hypotheses. 

3.5 e+e" — ^ He+e", H — > bb analysis 

Particle multiplicity and transverse momentum imbalance cuts are applied in order to select 
an initial sample of hadronic events. Most of the e"'"e~ — *• e"'"e~qq background is rejected by 
requiring a visible event mass greater than 50 GeV. The b-quark purity is increased by a cut 
on the the event tag discriminant (Stag > 2). Events are constrained to two jets by means of 
the Durham algorithm [2ZI. Those events with a 1/23 value in excess of 0.05 are rejected, where 
1/23 is the jet resolution parameter for which the transition from two to three jets occurs. As for 
the e"'"e~ e"'"e~H e"'"e~77 case, a kinematic fit is performed. A final cut on missing mass 
after the kinematic fit, M^iss, is required in order to reject a large fraction of the e"'"e~ — >■ bb7 
background. For Higgs masses above 95 GeV, we require Mmiss > 0.09y/s. For lower Higgs 
masses this requirement is tightened to Mmiss > OAAy/s to further reject the e+e~ — >• Z7 
contamination. Figure Etl shows the invariant mass distribution of the selected events for the 
mn = mz hypothesis after kinematic fit. 

After these cuts, the remaining background corresponds mostly to e"'"e~ —>■ qq(7) events, 
with a small contribution from e"'"e~ — » W"^W~ and e"'"e~ — >■ e"'"e~qq events. The distribution 
of the kinematic fit shows the largest sensitivity to the signal and is used to set the limits on 
r(H — >■ 77) Br(H — i> bb) presented in Table El and Figure El 

4 Limits on anomalous couplings 

The analyses performed over the different Higgs production mechanisms and decay channels 
show that the experimental data agree with the SM MC predictions. This agreement is quan- 
tified in terms of limits on the anomalous parameters d, ds, Agf and Ak,^. 
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Table 5: Number of selected candidates, background events, signal acceptances and limits on 
r(H — i> 77) Br(H — i> bb) from the e"'"e~ e^e~H — e"'"e~bb selection for different Higgs mass 
hypotheses. 

4.1 One-dimensional limits 

Exclusion limits for each individual coupling are derived as a function of the Higgs mass fol- 
lowing criteria similar to the ones employed in the SM Higgs search P]. For a given coupling 
X, a point in the (mH,a;) plane is considered as excluded at the 95% CL or more if the ratio 
of the confidence level for the "signal+background" hypothesis to the confidence level for the 
"background-only" hypothesis is less than 0.05. In this study all other couplings are assumed 
to be zero. 

The results for the four parameters: d^, Agf and Ak^ are shown in Figures El and El 
In addition to the combined results obtained using all processes under study, the individual 
results for the most sensitive channels are also displayed. 

In all cases, the e"'"e~ HZ searches are enough to exclude the region mn ^ \fs—mi for any 
value of the anomalous coupling. The fermiophobic e"'"e~ — > HZ, H — 77 search is sensitive to 
large values of d and lis, for which there is an enhancement of the H — > 77 branching fraction. 
The standard search for e+e~ — >■ HZ, H bb, r+r^ covers the region ^ ~ 0. 

The e+e^ H7 777 and e+e~ — > e"'"e~H — > e^e~77 channels are sensitive to large 
values of H77 couplings, i.e. to large values of the combination (isin^6'w + (i_BCOs^6'w (Figure 
E}. On the contrary, the e"*"e~ — > H7 Z77 process has a dominant role when H — > 77 is 
suppressed (Figure E])- This is the case for the fits to lS.g\ and Ak^ in the Higgs mass range 
Tfij, < y/s < 2mw- The sensitivity of the e"'"e~ H7 bb7 channel (Figure El at mn ~ rriz) 
concerns the region in which H — 77 is small, the HZ7 coupling is large and the H — Z7 decay 
is kinematically not possible. The reduced sensitivity of the e"'"e~ e"'"e~H e+e~bb process 
is due to the strong decrease of the H — bb branching fraction in the presence of large H77 
couplings. 

The sensitivity of the analysis degrades rapidly when mn approaches the 2mw threshold, 
where the H W^W~ decay becomes dominant even in the presence of relatively large anoma- 
lous couplings. 

Another usual assumption |3J is to consider that all anomalous interactions have the same 
strength F at the scale of new physics A, i.e. F/ Is?' = An-y = —d = —ds/ tan^6'w = 

2 cos^^w A(yff . This choice, although reasonable in what concerns orders of magnitude, is very 
particular. It implies the absence of an anomalous H ^ Z7 decay and a large exclusion power 
for the channels sensitive to the H77 coupling. We show the excluded regions under this 
assumption in Figures El and El 
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4.2 Two-dimensional limits 



The 95% CL contours obtained from a likelihood fit in the {d, ds) plane, taking into account 
all analyzed processes, are shown in Figure [7| for different Higgs masses. In this fit we assume 
that the couplings Agf and A/t^ are zero. The e"'"e~ —>■ H7 Z77 process helps in excluding 
large values of the anomalous couplings in the region where dsin 

^^w + ds cos^^w ~ 0. The fit 

is reinterpreted as a fit in the (r(H 77), r(H ^ Z7)) plane. The results are also presented 
in Figure [7| for different Higgs masses. 
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Figure 1: Relevant processes in the search for H77, HZ7 and HZZ anomalous couplings at 
LEP: a) e+e" H7, b) e+e" He+e" and c) e+e" HZ. 
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Figure 2: Distributions of the reconstructed Higgs mass, Mrcc, for a) e"'"e~ —>■ H7 — * 777, 
b) e"'"e~ — > H7 hh'-f, c) e"'"c~ c"'"e~H e"'"e~77 and d) e^e~ c"^c~H e^e^bb 
event candidates. The data arc compared with the MC expectations in the presence of an 
anomalous Higgs signaL a), b) and c) correspond to Higgs mass hypotheses with a relevant 
signal significance, d) illustrates the large suppression of e''"e~ — > Z7 background in the e''"e~ 
e+e"H — > e+e^bb selected sample, as no large peak structure is observed at the Z mass. 
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Figure 3: Cross section 95% CL upper limits as a function of the Higgs mass, mn, for the 
e'^'e" — > H7 777, e"'"e~ — > H7 hh'j and e'^'e" — > H7 — > Z77 processes in the presence of 
anomalous Higgs couphngs at ^/s — 189 GeV. 
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Figure 4: Upper limits at the 95% CL on the quantities r(H — > 77) Br(H 77) and 
r(H 77) Br(H bb) as a function of the Higgs mass, mn, from the analysis of the 
e+e~ — > He+e" process in the presence of anomalous Higgs couphngs at ^/s — 189 GeV. 
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Figure 5: Excluded regions for the anomalous couplings a) d and b) as a function of the 
Higgs mass mn- Limits on d are obtained under the assumption ds — ^gf — Ak^ = 0, while 
limits on ds assume the relation d — Agif = Ak^ = 0. The regions excluded by the most 

sensitive analyses: e"'"e~ H7 777, e+e" e+e'H e+e~77 and e+e" HZ are also 
shown. In addition, wc show the limits reached under the assumption of equal couplings at the 
scale of new physics A (dashed lines) as described in the text. 
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Figure 6: Excluded regions for the anomalous couplings a) Agf and b) Ak.j as a function of 
the Higgs mass mn- Limits on Agf are obtained under the assumption d — ds — Ak-^ — 0, 
while limits on Ak-^ assume the relation d = = Agf = 0. The regions excluded by the most 
sensitive analyses: e+e" H7 T^^n^ e+e^ H7 bb7 and e"'"e~ — ^ HZ are also shown. In 
addition, wc show the limits reached under the assumption of equal couplings at the scale of 
new physics A (dashed lines) as described in the text. 
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Figure 7: Allowed regions at more than 95% CL in the a) {d, ds) and b) (r(H 77), r(H — > 
Z7)) planes for different Higgs mass assumptions. All analyzed channels are used. The results 
are consistent with the SM expectations: d and r(H — > 77) ^ r(H Z7) 0. 
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